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Description 

METHOD AND APPARATUS FOR 
TRANSFORMING A HIGH DYNAMIC 
RANGE IMAGE INTO A LOW DYNAMIC 

RANGE IMAGE 

Background of Invention 
[000 1 ] 1. Field of the Invention 

[0002] The present invention relates to an image processing 
method. In particular, the present invention discloses a 
method and an apparatus for transforming a high dy- 
namic range image into a low dynamic range image. 

[0003] 2. Description of the Prior Art 

[0004] The dynamic range of a scene is defined to be a ratio of 
the highest scene luminance to the lowest scene lumi- 
nance. Generally speaking, a standard display device such 
as a CRT monitor or an LCD monitor has a dynamic range 
of about 250:1, and covers about half of the visible color 
gamut. However, the human vision system (HVS) has a dy- 



namic range greater than 10,000:1, and is capable of dis- 
tinguishing about 10,000 colors at a given brightness. In 
addition, a computer-generated image (CGI) commonly 
has a factor of 3000 between the highest and lowest in- 
tensity values. 

[0005] Typically, the image displayed on the standard display de- 
vice corresponds to intensities spanning 256 gray levels. 
That is, each color channel (R, G, B) is determined by 8 
bits. Therefore, the minimum gray level is equal to 0, and 
the maximum gray level is equal to 255. From the above 
description, it is obvious that the dynamic range in real- 
world environment far exceeds the representable dynamic 
range shown on the standard display device. 

[0006] An image having a great dynamic range is commonly 

called a high dynamic range (HDR) image. Currently, there 
is no simple and direct method to capture and render the 
high dynamic range images. One technique of capturing 
HDR images involves the use of multiple exposures for the 
same scene. Therefore, a plurality of images correspond- 
ing to the same scene are obtained, but the images are 
captured at different exposures. That is, the differently 
exposed images provide different luminance data. Then, 
the images are combined together via a prior art algo- 



rithm to determine the real radiance levels of the scene, 
and the HDR image corresponds to the wanted scene is 
obtained. 

[0007] Having successfully recorded the HDR images, the next 

step is to store the images. Existing digital image formats 
are mostly adopted for conventional display devices. As 
mentioned above, images commonly use 8 bits to store 
each color channel for driving standard display devices 
successfully. It is obvious that the corresponding dynamic 
range of the prior art format is insufficient for the HDR 
image data. Then, several file formats have been devel- 
oped to solve this problem. The simplest way to increase 
the dynamic range available to digital images is to in- 
crease the number of bits per channel. One example is the 
logLuv encoding scheme that uses 4 bytes per pixel. It is 
well-known that 2 bytes are used for encoding the loga- 
rithm of the luminance Y, and the other two bytes are 
used for encoding the u channel and v channel of the Luv 
color space. 

[0008] After the HDR image is successfully generated, a tone 

mapping procedure is used for reproducing the captured 
scene on a standard display device with the help of the 
rendered HDR image. In other words, the tone mapping 



process converts the luminance values recorded by the 
HDR image into luminance values suitable for driving the 
standard display device with a low dynamic range. There- 
fore, the main objective of the tone mapping procedure is 
to compress the wide dynamic range to fit the dynamic 
range of the standard display device. It is well-known that 
a tone reproduction curve (TRC) or a tone reproduction 
operator (TRO) is applied to the image data associated 
with the HDR image. For the tone reproduction curve, 
each pixel is transformed from its current luminance value 
to a new display intensity within the dynamic range of the 
standard display device. The tone reproduction curve cor- 
responds to a transformation function that is independent 
of spatial distribution, and every pixels of the HDR image 
are processed by the same transformation function. Re- 
garding the tone reproduction operator, spatial context is 
used for adjusting luminance of each pixels. That is, two 
pixels of the same luminance value may be mapped to 
different display intensities with the dynamic range of the 
standard display device, or two different luminance values 
may be mapped to the same display intensity within the 
dynamic range of the standard display device. 
[0009] Tone mapping techniques can also be used to tune the 



display quality of the captured HDR images. For example, 
the prior art tone mapping process will simulate the re- 
sponse of the human eye. Please note that the HDR image 
is formed by combining many images captured at differ- 
ent exposures. That is, the rendered HDR image originally 
has no visual artifact. However, the human vision is full of 
visual artifacts such as glares at higher luminance and 
blurs at lower luminance. Therefore, the prior art tone 
mapping process will introduce the visual artifacts inher- 
ent in human vision into the LDR image rendered from the 
HDR image. Though the final LDR image shown on the 
standard display device corresponds to what an observer 
sees the captured scene, the image quality is degraded 
owing to the introduced visual artifacts. In addition, it re- 
quires complicated real-time calculation to add the 
wanted visual artifacts into the LDR image, and the time- 
consuming computation certainly leads to poor image 

processing efficiency. 
Summary of Invention 

[0010] it is therefore a primary objective of this invention to pro- 
vide a method and an apparatus for transforming a high 
dynamic range image into a corresponding low dynamic 
range image. 



[001 1] Briefly summarized, the preferred embodiment of the 
present invention discloses a method for converting a 
high dynamic range image into a low dynamic range im- 
age. The high dynamic range image has a plurality of pix- 
els, and the pixels respectively correspond to a plurality of 
first luminance values. The method includes following 
steps: (a)converting the first luminance values associated 
with the pixels into a plurality of second luminance val- 
ues, a second luminance range of the second luminance 
values being smaller than a first luminance range of the 
first luminance values, and(b)utilizing a film transfer func- 
tion for mapping the second luminance values associated 
with the pixels into a plurality of third luminance values to 
generate the low dynamic range image, wherein the film 
transfer function adds no visual artifact to the low dy- 
namic range image. 

[0012] Th e preferred embodiment of the present invention also 
discloses an image processing system. The image pro- 
cessing system comprises an image generator for gener- 
ating a high dynamic range image, wherein the high dy- 
namic range image has a plurality of pixels, and the pixels 
respectively corresponding to a plurality of first luminance 
values, and an image processing logic for converting the 



first luminance values associated with the pixels into a 
plurality of second luminance values and utilizing a film 
transfer function for mapping the second luminance val- 
ues associated with the pixels into a plurality of third lu- 
minance values without adding visual artifacts to generate 
a low dynamic range image. In addition, a second lumi- 
nance range of the second luminance values is smaller 
than a first luminance range of the first luminance values. 

[0013] it j S an advantage of the present invention that a film 

transfer S-curve is utilized. The resulting LDR image is a 
realistic-looking photograph without the visual artifacts, 
and the final LDR image shown on the standard display 
device is clear. With the help of the film transfer S-curve, 
contrast for pixels originally with luminance value in the 
middle luminance range is improved, and corresponding 
details are clearly shown. In addition, the film transfer S- 
curve is pre-defined, and is not calculated during the tone 
mapping process. Therefore, it is easier to implement the 
claimed method, and the image processing performance 
is better than before. 

[0014] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 



ferred embodiment, which is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 

[0015] pig.l is a flow chart of a tone mapping process according 
to the present invention. 

[0016] pig. 2 is a schematic diagram illustrating a global gradient 
compression according to the present invention. 

[0017] pig. 3 is a schematic diagram of a film transfer S-curve ac- 
cording to the present invention. 

[0018] Fig. 4 is a block diagram of an image processing system 

according to the present invention. 
Detailed Description 

[0019] please refer to Fig.l, which is a flow chart of the tone 

mapping process according to the present invention. The 
tone mapping process according to the present invention 
is described as follows. First, an HDR image is loaded 
(step 100). The HDR image, as mentioned above, is gen- 
erated from a plurality of images captured at different ex- 
posures, and the HDR image corresponds to a wide dy- 
namic range greater than that of a standard display de- 
vice. Therefore, the original dynamic range of the inputted 
HDR image needs to be compressed into a new low dy- 



namic range available to the standard display device. In 
addition, the human visual system is not very sensitive to 
absolute luminance, but rather responds to local lumi- 
nance changes and reduces the effect of large global illu- 
mination differences. Therefore, a global gradient com- 
pression is performed to compress the original dynamic 
range and reduce the global illumination differences. In 
order to simplify computation complexity and implemen- 
tation, a spatially invariant operator is given by: 



1 + Z_(jr,v) 



Equation (1) 

[0020] The L (x,y) represents a "world" or "raw" luminance for 



w 



the pixel (x,y) on the HDR image, and the L (x,y) repre- 

d 

sents a scaled luminance corresponding to the pixel (x,y). 
Please refer to Fig. 2, which is a schematic diagram illus- 
trating the global gradient compression according to the 
present invention. As shown in Fig. 2, the L (x,y) corre- 

d 

sponds to a normalized gray level for the standard display 
device, that is, the L (x,y) lies in the interval [0,1]. It is 

d 



obvious that L (x,y) corresponding to a high luminance 



w 



value is approximately scaled by L (x,y) itself, and the L 

w w 

(x,y) corresponding to a low luminance value is approxi- 
mately scaled by 1. The denominator causes a graceful 
blend between these two scalings, and the equation (1) is 
guaranteed to bring all world luminance values into an 
available dynamic range. For example, the original high 
luminance values are greatly compressed to be available 
display luminance values for a specific display device. 
[0021] Then, a histogram equalization is performed to improve 
contrast of the adjusted image associated with the scaled 
luminance values (step 104). The histogram equalization 
transforms the histogram of the adjusted image into an 
approximately uniform histogram. Suppose that a cumu- 
lative frequency distribution P(b) is needed to equalize a 
histogram, and the cumulative frequency distribution P(b) 
is defined as: 

m = Y>,>f&) 



T 



Equation (2) 

[0022] The symbol T stands for the total number of histogram 



entries. Therefore, P(b) is the frequency distribution for 

i 

the histogram bin at b., and f(b.) is the frequency count for 
the histogram bin at b.. The histogram equalization ap- 
plied to an inputted image would produce an outputted 
image whose brightness values have equal probability. 
The equalization formula can be written as: B =log(L 

d 

. . )+[log(L )-log(L . )]*P(B) Equation (3) 

dmin dmax dmin 

[0023] The symbol B d represents the adjusted display brightness, 
and the symbol B stands for the raw image brightness. 
The log(L ) is the minimum brightness shown on the 

dmin 

standard display device, and the log(L ) is the maxi- 

dmax 

mum brightness shown on the standard display device. 
After re-distributing luminance values of the pixels in the 
inputted image, the outputted image then has better con- 
trast to display more details. 
[0024] However, if half the pixels have luminance values lower 
than 0.2*L , that is, a small luminance range [0,0. 2*L 

dmax 

] will use half of the available display luminance val- 

dmax 

ues shown on the standard display device. Therefore, the 
contrast of the adjust image may be overemphasized. For 
instance, suppose that two adjacent pixels of the raw im- 
age originally have a small luminance difference. After the 
above histogram equalization is performed, the luminance 



difference is enlarged. This results in an unnatural ap- 
pearance of the image, and the display quality is also de- 
graded. Therefore, a histogram adjustment is executed to 
prevent the contrast of the final image from being ampli- 
fied exaggeratedly (step 106). The histogram adjustment 
limits the contrast by implementing a ceiling condition. In 
the preferred embodiment, the ceiling condition is imple- 
mented as follows: 



[0025] 



dL ' L 

Equation (4) 

[0026] jhe equation (4) implies that the contrast cannot exceed 
the contrast obtained by using a well-known linear scaling 
operation whose slope is equal to L /L. From the equation 

d 

(2) mentioned above, it is well-known that following in- 
equality is derived: 



log tan™ ) " l<>g (Atato ) 



Equation (5) 



[0027] jhe symbol Ab stands for [log(L )-log(L )]/N, wherein 

max min 



N is the number of histogram bins, log(L ) is the maxi- 

max 

mum brightness for the raw image, and log(L . ) is the 

min 

minimum brightness for the raw image. Therefore, the 
symbol Ab corresponds to the size of each bin. As hinted 
by the equation (5), it is sure that the resulting histogram 
of the adjust image will not exaggerate contrast as long 
as no frequency count of the histogram bin exceeds the 
upper bound, that is, L /L In the end, the outputted im- 

d 

age has no overpopulated histogram bin. 
[0028] After the step 106 is done, the preferred embodiment ac- 
tivates a mapping operation through utilizing a film trans- 
fer S-curve (step 108), and the final LDR image is then 
successfully generated (step 110). Please refer to Fig. 3, 
which is a schematic diagram of a film transfer S-curve 10 
according to the present invention. The horizontal axis 
stands for the input luminance, and the vertical axis 
stands for the output luminance. The film transfer S-curve 
10 corresponds to a sensitization response of a photo- 
graphic film. As shown in Fig. 3, the input luminance val- 
ues located within the middle range (10~1000) approxi- 
mately occupy a full range of the output luminance values. 
In other words, the film transfer S-curve 10 increases the 
contrast of the middle luminance regions in the image. 



Therefore, the contrast corresponding to the high lumi- 
nance regions and the low luminance regions is greatly 
depressed. That is, the perceived quality of the final LDR 
image is greatly improved. 
[0029] The tone mapping process according the present inven- 
tion is capable of being run on an image processing sys- 
tem for transforming an HDR image to an LDR image. 
Please refer to Fig. 4, which is a block diagram of an image 
processing system 20 according to the present invention. 
The image processing system 20 comprises an image 
generator 22 and an image processing logic 24. The im- 
age generator 22 is capable of generating a high dynamic 
range image, and the image processing logic 24 is capa- 
ble of performing a tone mapping process to transform 
the HDR image into a corresponding LDR image. For in- 
stance, the image processing system 20 is a digital cam- 
era. The image generator 22 within the digital camera in- 
cludes a CCD module for capturing incident light to gen- 
erate a corresponding image and a camera shutter for 
controlling the exposures of the CCD module. Therefore, 
the image generator 22 can capture a scene via the CCD 
module, and is capable of generating a plurality of images 
captured at different exposures through appropriately 



controlling the camera shutter. Then, the image generator 
22 generates an HDR image corresponding to the cap- 
tured scene by combining these images together accord- 
ing to the prior art algorithm. 

[0030] The image processing logic 24 then is activated to process 
the HDR image. Therefore, the image processing logic 24 
runs the steps 102, 104, 106, 108 to render the desired 
LDR image. Because the image processing logic 24 such 
as a digital signal processor (DSP) utilizes a simple film 
transfer function, the related computation is simple. Gen- 
erally speaking, the digital camera has a small LCD screen 
for previewing the captured scene. Because the image 
processing logic 24 has better image processing efficiency 
by using the simple film transfer function, a user can 
quickly preview the LDR image on the LCD screen. In ad- 
dition, the rendered LDR image has better picture quality 
because no visual artifact is added to the LDR image. 

[0031] Another embodiment is that the image generator 22 can 
capture a scene to generate a plurality of images captured 
at different exposures only. Then, the required HDR image 
is further rendered by the image processing logic 24. 
Similarly, the image processing logic 24 also is capable of 
running the steps 102, 104, 106, 108 to render the final 



LDR image. 

[0032] As mentioned above, the image processing system 20 is a 
digital camera so that the image generator 22 and the im- 
age processing logic 24 are positioned in the same hous- 
ing. However, the image processing system 20 can be 
built by individual apparatuses. For example, the image 
generator 22 is a digital camera, and the image process- 
ing logic 24 corresponds to a computer host. Therefore, 
the image data outputted from the image generator 22 
are delivered to the external image processing logic 24 for 
following advanced image processing. 

[0033] As mentioned above, the prior art adds visual artifacts to 
the final LDR image so as to stress the visual accuracy. 
However, the display quality of the LDR image is worsened 
owing to the introduced visual artifacts. In addition, the 
time-consuming reproductions of human visual artifacts, 
such as glares at higher luminance and blurs at lower lu- 
minance, deteriorates the image processing performance. 
In contrast to the prior art, the present invention adopts a 
film transfer S-curve instead. The resulting LDR image is a 
realistic-looking photograph without the visual artifacts, 
and the final LDR image shown on the standard display 
device is clear. With the help of the film transfer S-curve, 



contrast for pixels originally with luminance value in the 
middle luminance range is improved, and corresponding 
details are clearly shown. In addition, the film transfer S- 
curve is pre-defined without being dynamically calculated 
during the tone mapping process. Therefore, the imple- 
mentation of the claimed tone mapping process is easy, 
and the image processing performance is better. 



